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Summary 

The article deals with gradient-like iterative methods for solving nonlinear operator 
^ ■ equations on Hilbert and Banach spaces. The authors formulate a general principle of 

. studying such methods. This principle allows to formulate simple conditions of convergence 

^ ! of the method under consideration, to estimate the rate of this convergence and to give 

_ ' effective apriori and aposteriori error estimates in terms of a scalar function that 

Q ' is constructed on the base of estimates for properties of invertibility and smoothness of 

C/^ ■ linearizations of the left-hand side of the equations under study. The principle is applicable 

OO . for analysis of such classical methods as method of minimal residuals, method of steepest 

descent, method of minimal errors and others. The main results are obtained for operator 
' equations on Hilbert spaces and Banach spaces with a special property, that is called 

Bynum property. 

> 

^ ' The method of steepest descent [H], method of minimal residuals [IT], method of 

minimal errors [71 [8] and some other gradient-like methods are simple and effective tools 
of studying and solving linear operator equations on Hilbert spaces. In the articles of 
^ : M. Altman ([H El [3]), L.V. Kivistik (HH), V.M. Fridman ([9]) some modifications of 

CN ! these methods for nonlinear operator equations were investigated. An account of these 

methods for linear and nonlinear operator equations was presented in the book [IH|. All 
these methods are based on a simple idea that the passage from the iteration Xn to 
Q\ • the iteration Xn+i, for each step, is realized in such a way that the value of residual at 

Xn+i is less than the value residual at x„. It turns out [HI El [121 [24l [25] that, under the 
O '. standard conditions of convergence for the classical methods of steepest descent, minimal 

residuals, minimal errors, and others, the analysis of these methods is reduced to the 
construction of a scalar function d{-) (sometimes it is called the relaxation function) such 



^ ■ that the inequalities < n = 0,1,2,..., hold. Moreover, the graph 

of this function allows us to give a sufficiently full characterization of the method in use: 
conditions of its convergence and rate of this convergence, apriori and aposteriori error 
estimates and so on. In addition, these conditions are usually more general than the classic 
ones and the corresponding error estimates are more proximate. At last, the approach, 
based on the analysis of function d{-) can be extended onto operator equations on Banach 
spaces. 

In this paper we present the analysis of the approach described above within the 
frames of investigation of gradient-like iterative methods and obtain the corresponding 
convergence conditions of these methods, estimates for the rate of this convergence and 
APRIORI and aposteriori error estimates of the corresponding approximations. 

1. Let X be a Hilbert space and let B{xo, R) (c X) denote the ball with the center 
xq and of the radius R. We are interested in the solvability of the equation 

fix) = (1) 
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in the ball B{xo,R) and in the convergence of the approximations 

Xn+l = Xn- A{XnJiXn))T{Xn)fiXn) (n = 1, 2, . . .) (2) 

where 

/: B{xo,R) icX)-^X, 

T: B{xo,R) {CX)^L{X), 

A : S(xo, R) X X {c X X X) ^R. 

We assume that / is Frechet-differentiable at every point of B{xo,R) and T,A,f satisfy 
the conditions 

A{xJ{x))<X{r), \\T{x)\\ < e{r) {\\x - xo\\ < r, < r < R) (3) 

||/(x)|ri/(x)-A(x,/(x))/'(x)T(x)/(x)|| </i(r) (||x-Xo||<r, < r < R) (4) 

||f(xi)-/'(x2)||<a;(r,||xi-X2||) 
{\\xi — xq\\, \\x2 — Xo\\ < r, < r < R). 
Let us introduce the following functions: 



t 



d{r,(f)) = fx{r)(f) + n{r,X{r)e{r)^) \^n{r,t) = j u{r,T) drj , (6) 



(i(o)(r,0) = ,/), rf("+i)(r» = rf(")(r,d(r») (n = l,2,...). (7) 

These function are defined on the interval [0,i?], the function d{r,(j)) is convex for small 
positive 0; its graph is presented at the following picture: 
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Let (/>*(r) be the smallest root at [0,-R] of the equation 

<P = dir,(P) (8) 
(we assume, that this root does exist). Put 



oo 



t/;(r,0) = 5^dW(r,0) (0 < < 0.(r)), (9) 



n=0 



This function is defined on the interval (O,0*(r)) and possesses the following important 
property: 

w{r,(l)) = (/) + w{r,d{r,(t))) (0 < < (/)*(r)) (10) 
Moreover, the following inequality 

w{r, <j)) < ^ (0 < (/)< Mr)) 

(p — d[r, <p) 

holds. 

Theorem 1. Let f,T,A satisfy conditions and a = ||/(xo)|| satisfies the 

inequality 

X{r)9{r)w{r, a) < r. (11) 

Then equation has a solution x^, G B{xo,R), approximations ((2]) converge to this 
solution x^, and the following inequalities hold 

\\xn -x4< X{r)e{r)w{r, ||/(a;„)||) (n = 0, 1, 2, . . .), (12) 
(aposteriori estimates) and 

\\xn- x4 < X{r)9{r)w{r,d^''\r,a)) (n = 0, 1, 2, . . .), (13) 
(apriori estimates); moreover, 

Velo (x„)jr=o < Lexp (x„)^=o < /^'(O). (14) 

Here Velo and Lexp are the velocity of the rate of convergence and Lyapunov's 
exponent for the sequence {xn)'^=o' 



Velo {xn)n=o = sup , Lexp {xn)^=o = limsup - 

n \\Xn X<f\\ n— »oo 

Proof. Let us suppose first that r, < r < ?/^*(r), is a number such that 

- a;o|| < r (n = 0, 1, 2, . . .). (15) 
In this case, we remark, that equation (l2|) implies the following identity 

f{Xn+l) = f{Xn) - A{Xn, f{Xn))f{Xn)T{Xn)f{Xn) + 
/(Xn+i) - f{Xn) - f'iXn){Xn+l - Xn) {u = 0, 1, 2, . . .). 
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(16) 



(17) 



This equation implies, in turn, the inequality 

||/(a:n+i)ll < WfM - A(x„,/(x„))/'(x„)T(2;„)/(x„,)|| + 

||/(a;„,+i) - - - (n = 0, 1,2, . . .)• 

We can estimate the first term by means of condition ((4]) (/i = 

- A(a:„, /(x„))/'(x„,)T(x„)/(x„)|| < ^(r)||/(x„)|| (n = 0, 1, 2, . . .)• (18) 

In order to estimate the second term in (fT7|) we note first that 

1 

\\f(x)-fix)-f'ix)ix-x)\\< [ \\f((l-t)x + tx)-fix)\\\\x-x\\dt 



and further, due to (l5l), one has 







1 

\\f{^-f{x)-f\x)ix-x)\\ < [ u;{r,t{\\x-x\\))\\x-x\\dt 







uj{r, r) dr = f2(r, ||x — x\ 







From this inequality we obtain that 

||/(x„+i) - f{Xn) - f'{Xn){Xn+l - X„)|| < fi(r, - X„||) {u = 0, 1, 2, . . .) 

and, further ((31) implies 

||/(x„+i)-/(x„)-/'(xO(x.+i-xOI| <f^(r,A(r)%)||/(x„)||) (n = 0, 1, 2, . . .)• (19) 

As result, from (fTSl ) and ( fT9l ) and the definition of d{r,(f)) (see ([6])) we have the 
following estimate 

||/(x„+i)l| <rf(r,||/(x„)||) (n = 0,l,2,...) (20) 

and 

bn+i-x„|| < \{r)d{r)d{r,\\f{xn)\\) (n = 0, 1, 2, . . .)• (21) 

Recall that all inequalities fl20l) - (l2Tl) were obtained under apriori assumption (fTSll . 
Inequality (fTSll for n = 1 is evident: 



lla^i - xoll = II A(xo, /(xo))T(xo)/(xo) || < \{r)9{r)a < X{r)e{r)w{r, a) < r. 
In a similar way, due to fl20l) for n = 1 one has 

||x2-xi|| = ||A(xi,/(xi))r(xi)/(xi)|| < A(r)^(r)||/(xi)|| < 
X{r)e{r)d{r, \\f{xo)\\ < X{r)e{r)d{r, a), 



and, due to (l2Ti ) for n = 2 we obtain 

\\x2 — a^ol I < — a^oll + ||a;2 — xi \\ < \{r)6{r){a + (i(r, a)) < A(r)6'(r)w(r, a) < r. 
Repeating this argument n times we obtain 

\\xk+i-Xk\\ < \\Aixk,f{xk))T{xo)f{xk)\\ < X{r)9{r)\\f{xk)\\ < 

(22) 

Xir)e{r)d{r, < . . . < A(r)^(r)dW(r, ||/(a;o)||) = A(r)^(r)dW(r, a), 



and, due to (1211) for A; = 1, 2, . . . , n we have 

lla^n - a:o|| < \\xi - xo\\ + \\x2 - + . . . + - < 

i(;(r, a) < r. 

Thus, by induction, inequalities (fT5|) hold for all n = 1,2,.... 



Now let us verify inequalities ( 1121 ) and ( iTSll . For each n = 0,1,2,... due to ([20] 
(replacing n by k) one obtains 



oo 

I Xr^ , ^ ^ 

fc=n fc=n 



A(r)%)5^dW(r,||/(a;„)||) = A(r)%)«;(r,||/(x„,)||). 

/c=0 

The latter means that (fT2l) is true. Iterating ([20l) we obtain the inequality 

||/(a;„)|| <d(")(r,a) (n = 0, 1, 2, . . .) 



and we see that (1131) follows from (1121) and this inequality. Replacing (1121) by (|22l) we 
obtain (fT3l) . 

Inequalities ( fT4l) follow from Figure presented above. 
The proof is complete. 

2. In this section we discuss some problems concerning conditions ([3]) and Since 
X is a Hilbert space one can replace condition ([4]) by the following inequality 

||/(x)f + 2A(x, /(x))(/(x), /'(x)T(x)/(x)) + A(x, /(x))2||f(x)T(x)/(x) f < 

(23) 

/i2(r)||/(x)f (||x-Xo|| <r,0<r<R). 

Therefore, verification of (I4|) is reduced to analysis of the following quadratic form 

||/(x)f + 2A(/(x), f'{x)T{x)f{x)) + A'\\f'{x)T{x)f{x)r {\\x - xo\\ < R) (24) 

(with respect to A = A{x,f{x))). Moreover, we can see here in what way the choice of 
the functional A{x,f{x)) infiuences the value of the coefficient /i(r). Naturally, we must 
try to choose this functional in such a way that the coefficient yu(r) would be less than 1 
and, when possible, would be minimal. 
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We remark that the inequality /i(r) < 1 is possible only in the case when the 
discriminant of the polynomial 

{l-l,'irmf{x)r + 2Aifix)J'ix)T{x)fix))+A'\\f'ix)Tix)fix)r 

(with respect to A) is positive: 

(/(x),/'(x)r(x)/(x))2-(l-^2(r)) ||/(x)f ||/'(x)T(x)/(x)|p>0. 

This inequality implies that (/(x), /'(x)T(x)/(x)) 7^ for all x, ||x — xo|| < R and 
for all /(x), /(x) 7^ 0. In what follows for definiteness sake we consider the case when 
(/(x), /'(x)r(x)/(x)) > for all x, ||x — xo|| < R with /(x) 7^ 0. In other words, in what 
follows we assume that 

(/(x),/'(x)T(x)/(x)) >0 (||x-xo|| <i?, h^O). (25) 
.M^ inf „^'t^;!f'gf'f!f'', (0<r<H). (26) 

lk-^oll<r ||/(X)|| ||/'(X)T(X)/(X)|| 

By virtue of ([25l) this function is nonnegative for a\\ < r < R. It is evident that iy{r) is 
nonincreasing and z/(r) < 1. Hereafter we assume that < zy(r) < 1. 

We consider two basic examples of the choice of functional A{x,h). 

The first example. The functional 

w ,x (hJ'(x)T(x)h) 

A x,/i = 1;;. ;1 27 
\\f'{x)T{x)hp 

makes the values of quadratic form fl24l) minimal. These values are 

, if{x),f{x)T{x)f{x)r 
11^^ ||/'(x)T(x)/(x)P ■ 

Under this choice of A(x, h) condition (l4|) holds with 



^(r) = VI - i^^(r). (28) 
In addition to this we have the equation 

||x-xo||<r ||/'(X)T(X)/(X)||2 

T/ie second example. The functional 

(^? is a scalar parameter, < ?9 < 2) converts quadratic form in (l24l) into the following 
expression 

2 , ||/(x)ini/'(x)r(x)/(x)ir 



^ nfix)J'ix)Tix)fix)y ' "■^^'^^ 
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In this case, condition (l4|) holds with 



We note in this case that inequality n{r) < 1 is true only when 

Hr) > 0<r<R. (32) 

Now, in this case, we have the equation 

^''^ ~ ^ \\.-Z<r {f{x)J'{x)T{x)f{x)y ^^^^ 

Thus, the verification of condition ^ in basic cases is reduced to the calculation of 
function (i26l l and defining its bounds. Remark that v{r) > u{r), where 

(hJ'(x)T(x)h) 

= „ „i^f „ „ 11,1 I II {0<r<R). 34 

||x-a;o||<r, ||fc||=l \\h\\ \\ f {x)T [x) h\\ 

Similarly, the verification of condition ([4]) in basic cases is reduced to the analysis of 
functions (1291) and (1331 ). Remark here that A(r) < A(r), where 

AM- sup (35) 

^ ^"ii.-.oy<Tii.iNi wmnxM- ^^^^ 

in the case when A(x, h) is defined by ( l27l ) and 

^^'^ ^ ^ ii.-.oy<T iNi=i (^^J^rW) ^^^^ 



in the case when A{x, h) is defined by ( l30l ). 

Let us clarify the sense of magnitudes defined by formulas (1341 ). ( 1351) . and ( l36l ). 

Inequalities ^'(r) > 0, < r < i?, (see (l34l) ) mean that operators f'{x)T{x), 
\\x — XqW < R, belong to the class of operators B : H ^ H possessing the property 

{h,Bh) > u\\h\\\\Bh\\, h e H, (37) 

where is a positive constant, characterizing each operator B. As far as we know, this 
class of operators has not been studied. Property (l37l) for a fixed operator B follows from 
the usual positive definiteness of the operator B. In its turn, it implies the property of 
positivity in the Krasnosel'skii - Samarskii sense. Geometrically inequality (1371) means 
that the angle between vectors h and Bh is acute. 

Inequalities A(r) < oo, < r < i?, with A(r) defined by (l35l) . mean that operators 
f'{x)T{x)^ \\x — XqW < R, belong to the class of operators B : H ^ H with the property 

{h,Bh) < X\\Bhf, heH, (38) 

where A is a positive constant, characterizing each operator B. This class of operators has 
not been studied as well. Remark that operators satisfying both properties (l37l) and (l38l ) 
have closed range; this situation holds, if functional A(x, h) is defined by formula (1271 ). 
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Inequalities A(r) < oo, < r < R, with A(r) defined by ( l36l l. mean that operators 
f'{x)T{x), ||x — xoll < R, are strongly positive definite in the standard sense (however, 
these operators need not necessarily be self-adjoint). 

3. Theorem 1 can be considered as a general principle of convergence for methods of 
gradient type. In particular, it includes numerous results for classical variants of method 
of minimal residuals, method of steepest descent, method of minimal errors and some 
others. Below, we present some of them. 

Example 1: Method of minimal residuals, see [17] and also [HI [241 [25] . In this 
case approximations are calculated by the formulas 

^ ""'^ ~ (n = l,2,...). (39) 

Functional A(x, h) correspondingly to them and operators T(x) are defined by means of 
the equations 

{h,f{x)h) 

Hence 

' \\.-Z<. ' ll".K^ 11/(2^)11 ll/'(i)/(^)ll 

and 

A(r) = sup sup ,1 , , , z/(r) = mf mf .,, ., ,, , , ,, . (40) 

||x-x.o||<r||/.||=l \\f'{x)h\\^ ||x-x.o||<r||MI=l ||/'(x)/l|| 

Example 2: Method of minimal co-errors, see [6]. In this case approximations 
are defined by the formulas 

11/ {Xn)f{Xn)\\ H* / \ c( \ / _ 1 9 \ (A^\ 

||/'(x„)r(x„)/(x„)P ^ ^^n)!{X^a) [n-i,Z,...). (4iJ 

Functional A(x, h) correspondingly to them and operators T{x) are defined by means of 
the equations 

^) = lij'/w^-flli|2 ' ^(^) = /'*(^)- 

\\f'{x)f' {x)h\\^ 



Hence 



^' II.-..IS, ii/ww/wp' ' ik-™ii<.- ii/wii ii/'wrw/(i)ii 

and 

A r = sup sup ..;'),:, ,,,, , i^ir) = mf mf ,.|| . 42 

\\x-xo\\<r \\h\\=l \\r{x)f' {X)h\\^ ||x-xo||<r |l/i||=l ||/i|| ||/'(2;)/' (x)/l|| 

Example 3: Method of steepest descent, see [TT], also [HI [16], [12], [5] . In this case 
approximations are defined by the formulas 

'^'^^^ = ^" ~ (/(xj', /'K)/(^n)) ^^^"^ (- = 1'2'---) (43) 
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Functional A{x, h) corresponding to them and operators T{x) are defined by means of the 
equations 



Hence 



\\fi^)r .r (fix), fix) fix)) 

A(r) = sup , z/(r) = mi 



||._,,^<.(/(X),/'(X)/(X))' ||.-.o||<r 

and 

A(r)= sup sup 7-4?!^, Hr)= inf inf .i^fff!",^,, - (44) 

\\.-,^\\<rl\h\\=l {h,f'{x)h)' \\.-.o\\<rm=l \\h\\\\f'{x)h\\ ^ ' 

Example 4: Altman's Method of steepest descent, see [HEjlH]. In this case 
approximations are defined by the formulas 

- - - .(/( J)'^!)/(.„)) '"-^■^••••> 

Functional A(a;, /i) corresponding to them and operators T{x) are defined by means of the 
equations 



Hence 



AW- sup , Jl^(;)l'^. mf 



ll.._.,^^<.^(/(x),/'(x)/(x))' ||x-.o||<. ||/(a:)||||/'(x)/(x)|| 

and 



A(r) = sup sup ,,, , z/(r) = inf inf ! j.^^^ln ■ (46) 

\\x-xo\\<r\\h\\=l ^{h,f'{x)h) ||x-xo||<r||/i||=l ||/'(x)/l|| 

Example 5: Method of minimal errors, see [7l[9l[l0]. In this case approximations 
are defined by the formulas 

Functional A(a;, h) corresponding to them and operators T{x) are defined by means of the 
equations 



Hence 



^^^'^^ = iir(x)/.ir T(x) = /'(x) 



w ^ ^ II/(^)IP . . ^ lir(a:)/(x)||^ 

M<Jir(^)/(^)iP' ii/(x)iiii/'(x)r(x)/(x)ii 
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and 

Example 6: Altaian's Method of minimal errors, see [H [2], [3]. In this case 
approximations are defined by formulas 

Functional A(a:, h) correspondingly to them and operators T{x) are defined by means of 
the equations 



Hence 



A(r) = sup v[r) = sup 



-.oy<.^iir(^)/(^)iP' \\.-.o\\<r 11/(^)11 ii/'(^)r(^)/(^)ii 

and 

\\hP _ \\f'*(x)hP 

A(r) = sup sup 11 . 11^ , z/(r) = inf inf , . . • (50) 

\\x-xo\\<r\\h\\=l m {X)h\\^ ||x-xo||<r||h||=l \\h\\ \\ f [x) f {x)h\\ 



4. It is natural to study possibilities of generalizations of the argument in 1-3 which 
is specific for Hilbert spaces onto the case of operator equations on Banach spaces. As 
was pointed out in 3 the assumption that H is a Hilbert space was used for the passage 
from condition (Jlj) to the analysis of the quadratic form in fl23l) . This passage is based on 
the classical identity for Hilbert spaces 

llx + yf = + 2{x,y) + llyf . (51) 

It is known that this identity is not true for Banach spaces. Moreover, this identity contains 
the scalar product and this means that all constructions of 1—3 are impossible in Banach 
space. 

However, we can try to use Lumer's semiscalar product [x, y] that can be defined on 
an arbitrary Banach space (see [IS]). Let us recall the corresponding definitions. 
Let X be a Banach space, X* its conjugate. The set 

= {I e X* : \\l\\ = \\x\\, {l,x) = \\xf} 

is nonempty due to Hahn - Banach theorem. If we have a selection 

J : X X*, Jx eZx 

of multifunction ^ : X i— > X* , we can define the semiscalar product 

[x,y] = {Jx,y). (52) 

The following properties of the product [x, j/] : X x X M are true: 
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(b) [Xx,y] = \[x,y], 

(c) [x,aiyi + 022/2] = <yi[x,yi] + "2 [2^,2/2], 

(d) [x,y] < \\x\\\\y\\. 

In articles [20l EH, [23l [4] the equivalence of the following properties of a Banach space 
X is proved: 

(i) + + (tIIx — > + {x,y e X), 

(ii) \\x + yf + \\x - yf < 2{\\x\\ + a\\yf) {x,y e X), 

(iii) \\{1-X)x + Xyf > {l-X)\\xf + \\\yf-a{l-X)X\\x-yf {x,y e X, < A < 1), 

(iv) llx + ?/||^ < + 2[a;, ?/] + cr||y|p {x,y e X), 

(v) {Jx - Jy,x - y) < a\\x - y\\^ {x,y e X), 

(vi) \\Jx - Jy\\ < a\\x - y\\ {x,y e X); 

here a is a number, o" > 1. Banach spaces with these properties are known as the spaces 
with Bynum's property. The spaces Lp [2 < p < 00), some Orlich spaces, and spaces 
with Hanner inequality are spaces with Bynum's property. Remark that in the case of the 
spaces with Bynum property the multifunction 3 is a usual single-valued function, or, in 
other words, in these spaces the semiscalar product is defined uniquely. 

Thus, if X is a Banach space with Bynum property, we can use the inequality 

\\x + yf< \\xf + 2[x,y] + a\\yf. (53) 

It is evident that this inequality can be used instead of equality (iSTi l in all the reasoning 
and constructions presented above for the case of Hilbert space. 

Now we return to operator equation ([T]) , however, in the case when the left-hand side 
of this equation is an operator f{x) on a Banach space X with the Bynum property. The 
semiscalar product [x, y] in this space allows us to consider instead of inequality ( l23l) the 
analogous inequality 

\\hf + 2A{x, h)[h, f'{x)T{x)h] + aA{x, hy\\f'{x)T{x)hf < fi\r)\\hf 

(54) 

(0 < r < r, 0<r <R). 

Now we can repeat the argument of the previous sections. In particular, we must investigate 
the left-hand side of this inequality: 

||/(x)f + 2A[f{x)J'{x)T{x)f{x)] + aA'\\f'{x)T{x)f{x)r {\\x - xo\\ < R). (55) 

Below we formulate an analogue to Theorem 1 for operator equations on Banach 
space X. Naturally, we deal with approximations (l2|) under the same assumptions (JS])- 
((5|). However, instead of function ([6]) we must consider the function 

t 

d„{r, 0) = /i(r)0 + aVL{r, A(r)^(r)0) (^{r, t) = j uo{r, r) ; (56) 



functions d^"'\r,(j)), n = 1,2,..., and w{r,<j)) are also replaced by the corresponding 
functions d^\r, (p), n = 1,2, . . ., and Wcr{r, (j)). In the proof of this analogue, only formula 
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(18) is changed essentially; of course functions d^^\r, 0), n = 1, 2, . . . are also replaced by 
functions d^a\r, 0), n = 1,2,..., and Wcr{r, (p). 

Theorem 2. Let f,T,A satisfy conditions and a = ||/(xo)|| satisfies the 

inequality 

X{r)6{r)wa{r,a) < r. (57) 

Then equation ([T]) has a solution G B{xo,R), approximations ([2l) converge to this 
solution x*, and the following inequalities hold 

||x„-x,|| < A(r)^(r)«;,(r,||/(x„)||) (n = 0, 1, 2, . . .), (58) 
(aposteriori estimates) and 

\\xn-x4< X{r)e{r)w^{r,S:'\r,a)) (n = 0, 1, 2, . . .), (59) 
(apriori estimates); moreover, 

Velo {x^)Z, < Lexp (x„)jr=o < /^'(O)- (60) 

Now we can write natural analogues for concrete iterative methods from Section 3. 
First, we remark that the analogues to (l27l) and fl30l) are 

^ [hJ'ix)Tix)h] 
""^^'^^ amx)T{x)hr ^^'^ 

and 



^^"'^^ = ^[/.,f(x)T(x)/.] - (^2) 

So, we obtain the following analogue to method ( l39l) in Example 1 (method of minimal 
residuals) 

Xn+i = a;„ ^77 — t^t — n^/O^n ^ = 0,1,2,..., (63) 

^^11/ (2^n)/(a;n)r 

and analogues to method (l43ll in Example 3 (method of steepest descent) 

xn+i = X. - -i^^^^J^^^^^ (n = 0,1,2,...), (64) 

[f{Xn)J'{Xn)f{Xn)] 

and to method (l45l) in Example 4 (Altman method of steepest descent) 

||/'(x„)/(2;„)||2 

^"^^"""~^[/(x„),/'(x„)/(x„)]^^^"^ (n- 0,1,2,...). (65) 

In all these cases T{x) = I for all x, \\x — xo\\ < R- 

Equations (l40l) for method (l39l) must be replaced by the equations 

~ [hj'{x)h] ■ f ■ f [hj'im 

A(r) = sup sup z/(r) = mf mf ,, . . ,, ■ (66) 

||x-xo||<r||h||=l nf'{x)h)\\^ ||x-xo||<r- ||h||=l \\f'{x)h\\^ 

Analogously, equations (l44ll for method (l43ll must be replaced by the equations 

X ll^ll' X . . [hj'(x)h] , , 

A(r) = sup sup iy{r) = mf mf ,, ,, , , (67) 

||x-xo||<r||/.||=i [h,f'{x)h] \\x-xo\\<r\\h\\=i ||/'(a;)/j|| 
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and equations (l46l ) for method (l45D must be replaced by 

^ ~, , r r (h,f(x)h) , , 

A r = sup sup " r = inf nf / 68 

The approach put forward here is not applicable for methods in Examples 2, 5, 
and 6, because the formal terms ||x — xo|| < R are not operators on X, if X 

is a Banach space. 

The main idea of the passage from Hilbert to Banach space can be generalized on a 
more general class of Banach spaces. In particular, we can consider the class of Banach 
spaces where the following inequality (see [22] ) 

holds, here p G (1, cxd), a > 1, 

[x,y]p = (JpX,y), 

and 

ZpX = {/ G X* : ||/|| = ||xf-\ {l,x) = llzf }, 

The simple example of such spaces gives the spaces Lp, 1 < p < 2. We omit the 
formulations of the corresponding results. 
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